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NOTICE;  When  government  or  other  dravlngB,  epeci- 
fl cations  or  other  data  are  used  for  any  purpose 
other  than  in  connection  with  a  definitely  related 
government  procurement  operation,  the  U.  S, 
Government  thci-ehy  incurs  no  reBponBihlllty,  nor  any 
obligation  whatsoever;  and  the  fact  that  the  Govern¬ 
ment  may  have  formulated,  famished,  or  in  any  way 
supplied  the  said  drawings,  specifications,  or  other 
dttlu  ib  not  to  be  regarded  by  implication  or  other¬ 
wise  as  in  any  manner  licensing  the  holder  or  any 
other  person  or  corporation,  or  conveying  lany  rigpits 
or  permission  to  manufacture,  use  or  sell  any 
patented  invention  that  may  in  any  way  be  related 
thereto. 


SUMMARY 


'\ 

A  nnimodel  rnn<-t,i on  of  one  variable  Is  defined  on  bji 
interval.  No  regularity  conditions  involving  continuity,  derl- 
vativGE,  etc.,  arc  assuinod.  V/e  wish  to  minimivic  the  nuiabcr 
of  calculations  of  values  of  the  function  In  order  to  assure 
the  location  of  its  maximum  to  a  prescribed  degree  of  accuracy. 
The  solution  of  this  problem  and  its  discrete  analogue  InvolveB 
the  well-knov/n  Fibonacci  sequence. 
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BEST  EXl’LORATION  FOR  MAXIMUM  IS  FIBOKACCIAN 

SeJmer  M.  Joiuifton 

When  the  fiuthor  obtained  the  result  presented  here,  he 
thought  it  v/as  new.  Subsequently,  it  was  Pound  that  the  result 
had  previously  been  published  by  J.  Kiefer  [1].  However,  the 
simplicity  of  the  present  proof  may  justify  a  short  note  on  the 
problem. 

In  some  practlcod  problems  the  only  way  to  locate  a 
maximum  of  a  function  is  to  observe  the  values  of  the  fimction 
at  various  points  and  u  ..mpare  them.  For  example,  the  function 
may  not  be  continuous,  or  perhaps  the  derivatives  may  be  too 
hard  t(j  find  analytically,  etc.  Wilh  thin  in  mind,  and  as  a 
first  step  towai'd  the  solution  of  the  general  problem,  we 
consider  the  case  of  a  unlmudul  function  on  an  interval . 

Definition:  A  function  f !x)  is  unlmodal  if  there  is 

an  such  that  f  Is  either  strictly  iaci'cusirig  for  x  < 
and  strictly  decreasing  for  x  >  x^,  or  else  strictly  increasing 
for  X  •'  x^  and  strictly  lacreHuiag  f'or  x  >  x„. 

0  ~  v} 

For  exaDi7)le,  concave  functions  are  uniraodal  . 

If'-  Kiefei’  contiiderr;  the  problem  ni'  datenninlug  an 

Intai’val  containing  the  poir.t  at  vfhich  a  unlmodal  function  on 
the  unit  Interval  possesses  a  maximum.  No  regularity  conditions 
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concerni.ng  continuity  or  derivativeG,  etc.,  are  assuBied.  He 
gives,  for  every  e  >  0  and  --veiy  ntaiiber  n  of  values  of  the 
argument  at  which  the  fun<;tloD  may  be  observed,  a  procedure 
which  is  e  -miniaiax  among  the  class  of  all  sequential  non- 
randomized  procedures  which  teiminate  by  giving  an  Interval 
containing  the  required  point,  where  the  payoff  is  the  length 
of  the  final  Interval . 

We  present  a  short  proof  of  the  result  after  it  has  been 
restated  as  follows. 


,  Theorem  1.  Let  y  *  f(x)  be  any  unlmodaJ  function  defined 
on  an  Interval  0  <  x  <.  L  .  Let  F  »  sup  of  all  L  with  the 
property  that  we  can  always  locate  the  maximum  of  f(x)  on  a 
unit-length  subiaterval  by  calculating  n  values  of  the  function. 


Then  F  is  the  n-th  Fibonacci  wumber:  that  is, 
n  ’ 

F  «  F  +  F 
n  n-1  a-2’ 


n  >  2, 


with  F 


0 


Fi  «  1. 


The  proof  wiil  be  by  induction. 

We  observe  first  that  »  I  follows  from  the 

definition  of  F^^,  since  Just  one  value  of  the  function  gives 
no  information  concerning  the  location  of  the  maximum. 

Fix  n  ;>  2  and  cfilculate  y^  «•  »  f(x2),  where 

0  <  If  >  Jp,  the  maximum  occurs  on  (o,  x^) 

since  f(x)  is  strictly  unimodaJ  .  If  y^  >  7^  j  "the  maximum  is 
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on  (x^,  L^),  If  «■  y^,  choose  either  of  the  above  Intervals, 
even  though  we  know  the  maximum  occurs  on  (x^,  Xg)  •  Thus  at, 
each  stage  after  the  first  computation  we  are  left  with  a  sub- 
interval  and  the  vo] ue  of  f(x)  at  some  interior  point  x.  Bince 
values  at  the  ends  of  an  intejval  do  not  always  give  usable 
information  relative  to  our  problem,  we  restrict  our  attention 
to  the  interior  points. 

For  n  >•  2,  *  2  -  e ,  take  *  1  -  e,  x^  =  1,  for 

arbitrarily  sma.!!  e  >  0.  By  the  argument  of  the  preceding 
paragraph,  we  have  Fg  *  ^  +  F^, 

Fix  n  >  2,  and  assume  that  1  ^k  2 

k  •=  2,  . . . ,  n  -  1 .  We  shall  show  that 

p  «  F  +  F 

n  n-i  . n-2 

i 

For  if  we  calculate  at  and  on  ):),  I,)  we  have  the  picture 


If  y.,j  have  the  new  picture 


But  then  x„  <  F  since  we  have  only  n-2  more  choices 
2  n-i 

with  x^  a  first  choice  for  the  case  k  * 


n  -  1 .  Moreover 
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X,  <  P  since  the  maxlmuan  could  occui’  on  (o,  x,  )  with  two 
1  n-2'  '  ^  1 

choices  of  x  already  used. 

Similarly  if  y  ,  >  y. ,  we  have  L  -  x,  <  F  ,  .  Thus 
2  1  n  1  n-1 

L  <  F  +  X  <  F  ,  +  F  ,,,  BO  that  F  <  F  ,  +  F 
n  n-1  1  n-1  n-?.’  n  -  n-1  n-P 

Now  choose  ^n-2^'  \  ‘  l^^n-2' 


and  X  =  (l  -  — )F  -  Since  e  is  arbitrarily  small  this 

2  2  n--l 


that  F 


n 


shows 

F  ,  +  F  ,  so  Theorem  1  is  proved.  Moreover,  the 
n-2' 


'  n-1 


procedure  is  optimal  for  a  given  e,  since  after  comparing  i(x^) 

and  f(x  )  we  are  left  with  an  interval  of  length  L  ^  *  (l  - 

'  2  <= 

^n  1’  with  a  varue  at  optimal  first  position  for  this 
smaller  Interval.  Continuing  in  this  way  we  have  Lj^  «  (1  - 
for  h  <  n;  in  particular,  L  «  |l  -  t^)F^  •  2  -  e,  and  the  final 
interval  is  of  unit  length. 

ti 

The  F  fom  the  eequence 

a 

1,  1,  2,  3,  5,  8,  13,  21,  34,  55, 


with  Fjjq  >  10000.  Thus  a  maxinum  can  always  be  located  within 

-  4 

10  of  the  original  Interval  length  with  20  calculations.  Using 
the  more  conventional  tochni(iue  of  computing  f  )<)  and  :  \y  •+•  e), 
where  x  is  at  the  midpoint  of  the  interval,  may  take  as  many  as 
28  computations. 

As  Kiefer  remarks,  since  F  /F  rapidly  approaches  its 
limit  T  “  ^(  +  I-)  *  could  choose  the  first  two 

values  of  x  at  l/t  »  .6l8  L  from  either  end  of  the  Interval.  This 
would  be  jui  excellent  approximation  at  each  stage  except  for  the 
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laBt  few  choices;  especially  if  n  is  not  fixed  in  advance  but 
is  determined  after  several  values  have  been  observed  (e.g.; 
more  observations  might  be  taken  if  the  function  appears  to 
be  shaiply  peaked  near  its  maximum).  This  constant  ratio  to 
determine  the  next  x  would  be  useful  in  a  cuiapuLing-machine 
code . 

A  line  segment  is  said  to  be  divided  according  to  the 
"golden  section"  if  one  part  is  t  times  the  other.  The 
approximation  suggested  above  gives  at  each  stage  an  intei-val- 
whlch  is  uivlded  by  the  golden  section  at  its  x  value  but 

reduced  in  scale  from  the  previous  intcr’/al .  ITiis  follows 

/  ,  ■■ 

from  the  relation 

.  -L./  T-:.  »  _ i—  -  T  ' 

L(1  -  i)  T-J 

The  Discrete  Case 

Theorem  2.  Let  y  *  f^x)  be  any  unimodal  function  defined 

on  a  discrete  set  of  H  points.  Let  K  >=  max  H  such  that  the 

n  n  n 

function's  maximum  can  always  be  identified  in  n  observations. 
Then 

“  -1  ^  ' 

Proof.  Niimber  the  points  1,  2,  '6,  ...;  Observe  that 

K  ••  1,  K  »  2,  K  *  4.  fix  n  >  3  and  assume  K  »  -1  +  Fi,,  n 

1  c.  it  K+  i. 

Cal.c;uJ.ate  f(-x)  at  x^  and  x^.  By  arguments  analogous 


for  k  "■  n. 
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H  <  K  -  + 
n  —  n-2 


1  +  K 


l)  +  1  +•  F  -  1 
n 


This  maximiun  Is  attained  when  x,  *  F  ,  and  x  *  F  .  Thus 

1  n-1  2  n 

Theorem  2  is  proved;  moreover,  the  optimal  construction  is 
given. 
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